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1 .  Introduction 


This  paper  presents  a  bounding  technique  fur  use  In  Implicit  enumeration 
algorithms  for  solving  the  Integer  linear  programing  problem  with  binary 
variables.  This  problem  may  be  stated  as  follows, 

n 


maximize 


•  l 

w 


CJ*J 


subject  to 
n 


(P) 


I  •lj*jibi*  <4  "  *•* . "> 

J-l  J  J 

Xj  -  0  or  1,  (J  -  l,2,...,n). 

The  main  assumptions  used  by  this  technique  are  (1)  the  linear  programing 
relaxation  of  (P), 


II 

maximize  x  -  [  C,V 

J-l  31 


subject  to 
n 


<V 


I  I  bi»  •  1.2 . m) 

J-l  3  " 

0  <  <  1.  (J  -  1,2 . n) 


possesses  a  unique  optimal  solution,  (2)  the  optimal  solution  to  (PR)  Is  not 

binary,  and  (3)  a  good  feasible  solution  to  (P)  Is  available.  If  (2)  does  not 

hold  then  the  optimal  solution  to  (l’R)  Is  also  the  optimal  solution  to  (P) 
and  the  algorithm  would  not  be  required.  Assumption  (3)  may  be  met  by 

using  one  of  the  many  heuristic  procedures  in  the  literature  (1,4, 6, 7].  An 

alternative  to  assumption  (3)  requires  that  a  lower  bound  on  the  optlml 

objective  function  value  of  a  related  problem  (P')«  defined  in  Section  3,  be 

available. 

In  what  follows  we  show  that  "joint”  bounds  can  be  obtained  on  the  values 
of  a  subset  of  the  variables  by  adapting  the  approach  used  by  the  Bound-and-Scan 
algorithm  (3)  In  which  the  variables  are  restricted  to  be  non-negative  integers 
rather  than  binary.  In  addition  we  give  good  indications  that  these  bounds  my 


_  ■»_ 


be  used  «((ici«atly.  Finally.  4  i  Ia*t  ol  problems  particularly  well-suited 
to  tills  bounding  procedure  is  specified. 


2.  Conceptual  Out  lino  ol  the  Hounding  Technique 

This  technique  la  Motivated  by  the  following  conalderat Iona.  In  an 
implicit  enumeration  algorithm  the  goal  la  to  quickly  eliminate  large  subsets 
of  the  2n  possible  combinations  of  values  for  the  variables  by  various  teats. 
Having  a  bound  on  the  objective  function  value  of  the  optimal  solution  provides  one 
such  teat  since  const  raining  feasible  points  to  yield  a  better  objective  function 
value  greatly  decreases  the  sice  of  the  feasible  region.  Also,  this  new  con¬ 
straint  assures  that  any  new  feasible  solution  will  decrease  the  sice  of  the 
feasible  region  even  further.  Moreover,  if  we  can  obtain  a  representation  for  a 
group  of  variables  that  (1)  allows  us  to  fix  the  values  of  some  of  the  variables 
in  an  optimal  solution  to  (P)  and  (2)  yields  "Joint"  bounds  on  them  which  allow 
systematic  generation  of  all  relevant  combinations  of  tneir  values,  we  will  have 
eliminated  even  K>re  of  the  2n  combinations.  Further,  if  the  number  of 
variables  In  this  group  is  large  as  a  function  of  n  and  we  use  the  "joint"  bounds 
in  a  computat Iona  1 ly  frugal  way,  additional  time  savings  will  be  achieved  as  a 
result  of  having  only  a  small  number  of  variables  to  deal  with  In  another  manner. 


The  technique  presented  here  seeks  to  take  advantage  of  these  ideas. 

Consider  the  region  determined  by  the  constraints  that  are  binding^  In  the 
optimal  solution  to  (F  ) ,  after  making  a  change  of  variables  (*'  -  1-x  )  for 

*  J  J 

those  variables,  x^,  whose  complements,  (1  -  * j > ,  were  nonbasic  In  this  solution 
[5,  pp.  659-662).  In  addition,  require  that  the  value  of  the  objective  function 


Here  we  exclude  constraints  that  are  binding  due  to  degeneracy. 


Hence,  the 


binding  constraints  are  those  constraints 
slack  variables  are  nonbasic  in  the  opt im, 


<l 

il  solution  to  (PR) 


■  l,2,...,m)  whose 
,  and  those  non¬ 


negativity  constraints  that  correspond,  after  the  change  of  variables,  to  nonbasic 


variables  in  this  solution. 
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solutlon  If  it  is  f edible  and  maximizes  the  objective  function  value  among 
all  feasible  solutions.  The  value  of  x(  for  an  optimal  solution  will  be 
called  the  opt!.*al  objective  function  value.  If  values  have  been  assigned  to 
only  certain  of  the  variables  (components  of  x),  this  specification  of  values 
will  be  called  a  partial  solution  for  these  variables.  Clven  a  partial  solution, 
a  "completion"  Is  a  solution  resulting  from  specification  of  values  for  the 
remaining  variables.  An  eligible  partial  solution  Is  one  that  docs  not  violate 
any  known  bounds  on  the  variables  involved,  i.e.,  one  that,  based  on  our  present 
inf or mat  Ion,  could  yield  a  completion  that  is  an  optimal  solution. 


The  optimal  solution  to  < P^)  may  be  Included  in  the  card  Input  stream  or 

(PR)  may  be  solved  during  Ini t la  1 lzat Ion  If  the  underlying  algorithm  Is  slmplex- 

*  *  *  T 

based.  In  either  case,  we  will  denote  this  solution  as  x  -  (x,,...,x  )  and 

i  n 

ft  * 

its  objective  function  value  as  xQ  •  c  x  .  Also  we  define 


“  U i i*  basic} , 
D  J 


>0  '  (Ji*j  - 


a  a 

0  and  x^  is  nonbasic). 


{ J 1  *  j  •  1  and  1  -  Xj  Is  nonbasic). 


jn  *  Jo  u  Jl* 

kb  -  { i | l  C  (  1 

S  -  (i. 


•  •  •  •  •  ■ 


*\ 

And  the  1th  constraint  Is  binding  at  x  /, 


,m/  -  Kb. 


We  wish  to  make  the  following  change  of  variables  to  define  x'  €  R  for 


any  x  €  R  , 


1-Xj, 

*J  ’ 


if  j  € 
otherwise. 


This  change  of  variables  directly  Induces  the  problem 


(P’> 


maximize  x^  “  c ' x ' 

subject  to 

A’  x’  <  b’ 


xj  -  0  or  1 
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f rom  (P).  Note  that  an  optimal  solution  to  (P'),  x,0pt,  yields  an  optimal 


solution,  x°pt,  to  (P)  via 


opt 

‘l 


i  -  *;opt  .  if  j  e  j1 


.opt 


J 


otherwise  . 


Henceforth  we  will  direct  our  attention  to  solving  (P'). 

For  notatlonal  convenience  It  will  be  assumed  that  the  original  Indexing 


of  the  x,  and  b,  was  such  that  If  n 


B 


|j  |,  than 


»■ (l . "»'• 


*  { 1, . . . ,n^} , 

Jjj  •  (iij+1, . . .  ,n), 

-  ( n B-*-l . . . .  ,m). 


(F) 


Finally  denote  the  Initial  good  feasible  solution  to  (P)  by  x  - 

,  F  F.T  „  .  ,(F) 

(Xj  , ...,XqJ  .  Now  define  x  by 


.  (F) 


1  -  x 


(F) 


(F) 


‘J 


if  J  €  J, 


otherwise. 


and  let  “  c'x,(F*.  Note  that  xQ 

objective  function  value  of  (P'). 


•  (F) 


Is  a  lower  bound  on  the  optimal 


4.  Technique  for  Bounding  {x,|j  €  J  } 

_ I _ J _ L_ 


Define  the  n  x  n  matrix  A*  whose  1th  row  Is 


Aj  i  1  “  1 ,  •  •  • , 0^ 
•Pj,  1  “  n^-fl , . . . ,n. 


where  e^  Is  the  unit  n-vector  with  unity  assigned  to  component  1.  Also  define 
b  €  Kn  whose  1th  component  Is 


bi- 
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1  »  1. 


•  ,nB 


1  •  n  +1 , . . . ,n. 

D 


Now  consider  the  set  of  points  satisfying 

(l)  A*  x  <  b*. 


(F) 

(il)  c’x  >  Kq  ♦ 

Since  (l)  Is  the  set  of  constraints  that  are  binding  on  x'*  (Induced  by 


x*  via  the  change  of  variables)  and  x 


,(F) 


Is  a  lower  bound  on  the  optlaul 


objective  function  value  of  (P*),  any  optimal  solution  to  (P * )  must  be  In  this 
set.  If  (c*x'*  -  c'x,(J>)  is  small, this  set  will  contain  few  binary  points 
and  the  search  for  an  optimal  binary  point  may  not  be  difficult. 

We  now  seek  to  find  the  (n«-l)  extreme  points  of  the  n-nimplex  defined  by 
(1)  and  (11).  The  first  n  extreme  points  are  determined  by  the  system  of 
equal  Ions, 

(1) 


A<4>  x<‘> 


(1  -  l, . . . ,n) 


where  A*1*  Is  obtained  by  replacing  row  1  of  A*  by  c ' ,  and  b^  Is  the 


vector  obtained  by  replacing  component  1  of  b*  by  xQ 
•(0)  - 


.(F) 


The  (n+1) 

(1) 


st 


extreme  point  is  x'~'  *  x'*  (3,  p.  646],  It  can  be  shown  that  A"'  Is 
nonsingular  (1  ■  l,...,n)  [3,  p.  646]  and,  hence,  we  have  explicitly 


(1)  .  ,.(1K-1  K(i)  , 

x  (A  )  b  .  (1  -  1 ,  •  • .  ,  n  )  . 
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Then  setting 


Mp  - 


yields  such  s  representation  for  x  via  p.  x  Is  In  the  simplex  determined 
by  (1)  and  (11)  If  and  only  if  0.  For  an  arbitrary  x,  g  exists  by  virtue 

of  the  fact  that  M  Is  nonsingular  (3,  pp.  648, 649),  so 


P  -  M 


If] 


provides  the  relevant  vector  a 

Fortunately,  this  representation  can  be  obtained  directly  without  explicitly 
performing  a  matrix  inversion,  since  A^  ■  bj  for  J  i  1  (by  definition 


of  A 


(l) 


and  b(l).  i  -  1 . n),  so 


bi  -*i 


•  •  D  * 

*  “  bl  “  i  P,  ^ 
j-0  J 


.0) 


•  *  *  to 

-  bi  -  (l  -  PJ)bi  -  PjA j  xv 

*  *  (1) 

“  PjO^  -  Aj  xKl>). 


Therefore, 


Pi  -  * 


•  * 

bi  "  A1  * 


h  A  x(1)  ’ 

bi  -1  ~ 


1 ,  •  •  •  ,  n 


and.  similarly. 


c  x  -  x„ 


.(F) 


^0  *  .  (0)  .(F) 


c  x  -  x; 


Solving  (P')  has  now  been  reduced  to  finding  those  x  with  g  >.  ®  which 
satisfy  the  constraints  of  (P')  that  are  not  binding  on  x'*  and  Identifying 
the  one  which  maximizes  c'x. 

It  can  be  shown  that  each  element  of  {x^ij  €  has  the  property  that  It 
has  value  zero  at  all  of  the  extreme  points  of  our  n-slmplex  except  one,  where 


-ti¬ 


lt  ha*  a  strictly  positive  value.  in  particular,  x  >  0  for  each  J  €  J  . 

J  ™ 

This  follows  from  Umu  3  ( 3 .  p.  646  J ,  which  for  completeness  Is  restated  here. 

l.emm.1 :  Under  the  assumptions  of  Section  1,  x^  (1  -  0 . n)  satisfies  con- 

*  (l)  * 

stralnts  (1)  and  (il).  Furthermore,  A^  *  <  bj  for  1  “  l,...,n  and 

_.„«>)  >  X,(F) 

-  -  0 


Hence,  for  J  €  J  , 
N 


«  * 

1l  *  rii— 

»,*  -  A,*.1!’ 


This  result,  combined  with  the  fact  that  pQ  Increases  as  the  best  known 
objective  function  value  of  (P  ’ )  increases,  yields  the  following  theorem 


13,  P-  652 J . 

Theorem:  A  necessary  condition  for  |x  . x  ]T  to  be  an  eligible  partial 

nB+i  D 

solution  to  <P * )  for  the  variables  whose  Indices  are  In  J  Is  that 

N 


n 

1 

J'V1 


o)  - 


<  i 


B 

P0  * 


where  pQB  is  the  value  of  p^  for  the  current  best  feasible  solution  to 

(P'),  xB  -  (x,B . x  B|T  (with  objective  function  value  x  *). 

This  leads  Immediately  to  the  following  corollary. 

Corollary :  If  x^  ^  <  1  where  J  €  J^,  then  x’  •  0  in  any  optlsuil  solution 

to  (P’>. 

Proof :  *  ^  <  1  Implies  that  1/x^^  >  1,  since  >  Hence,  p^  >  1 

when  Xj  •  1  and  this  partial  solution  for  x^  Is  not  eligible. 

Thus  we  may  set  xj  5  0  for  those  J  where  *  ^  <  1.  For  notatlonal 
convenience  let  this  occur  for  J  ■  n^  ♦  l,...,n^,  and  our  necessary  condition 


Is  now  reduced  to 
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n  *» 
L 


!*V‘  *j 


Thus ,  by  calculating  1/a^ *  for  J  •  nQ+l,...,n  once  at  the  outset  and 
updating  Pq  whenever  a  new  feasible  solution  to  (P*>  la  found,  a  single 
addition  and  comparison  are  needed  to  check  whether  a  current  partial  solution 
for  these  variables  remains  eligible  If  a  particular  value  Is  Increased  from  zero 
to  one.  Hence,  it  Is  simple  to  generate  all  the  eligible  partial  solutions  one 
at  a  time,  stopping  each  time  to  explore  Its  completions  using  the  underlying 
algorithm. 

X 

A  possible  enumeration  scheme  Is  Initiated  by  starting  at  |x  . . x  )  -  0 

n_+l  n 

Each  subsequent  partial  solution  Is  obtained  by  first  searching  the  set 

{x  il(..Mx  }  for  the  first  zero  value,  x  ,  and  then  setting  x  . .  -  x  ■  .. 
n0+l  n  q  nQ+l  nQ+Z 

x  ,  *  0  and  x  •  1  and  checking  the  necessary  condition  for  eligibility.  If 
q-1  q 

this  new  partial  solution  Is  not  eligible,  again  search  for  the  first  zero  value, 

x  .  and  set  x  ,  *0  and  x  •  1  and  check  for  eligibility,  etc. 

P  nQ+  1  p-1  P 

When  there  does  not  exist  a  zero-valued  variable  In  (x^  ....... x  )  the 

n0  1  n 

eligible  partial  solutions  have  been  exhausted  and  the  algorithm  terminates. 


5.  Computational  Considerations 

The  bounding  technique  presented  In  the  preceding  section  has  not  yet  been 
tested  for  computet lonal  efficiency.  However,  we  discuss  below  soaw  Indications 
that  it  will  be  efficient,  and  then  consider  which  kinds  of  problems  can  best 
take  advantage  of  It. 

(F) 

It  was  mentioned  in  Section  A  that  a  small  value  of  (c*x,#  -  c'x  )  is 
a  key  to  the  efficiency  of  the  technique.  Several  heuristic  procedures  for 
obtaining  x' ^  have  been  tested  and  shown  to  give  good  results  [9],  so  a 
relatively  dm 1 1  value  of  the  above  seems  to  be  a  reasonable  expectation.  Such 


a 


which 


d  value  also  tends  to  yield  relatively  small  values  for  the  x^  J  , 
greatly  reduces  the  number  of  partial  solutions  that  are  eligible.  For  example. 
If  1  <  <  2  for  all  J  ■  nQ  ♦  l,...,n,  then  the  number  of  eligible  partial 

solutions  grows  only  linearly  with  (n  -  n(j),  whereas  this  number  could  grow 


essentially  exponentially  If  the  x^  J  are  sufficiently  large. 


In  Identifying  the  extreme  points  *.* 1  * . g<n)  It  la  not  really 

necessary  to  find  the  (Atl^)  1  or  even  to  construct  the  A(1)  (or,  in  fact, 
A*)  in  a  s>  lap  lex-baited  code.  Beginning  with  the  Inverse  of  the  final  basis 
aatrlx  for  (PR)  (recalling  that  the  change  of  variables  does  not  affect  the  basic 
coluans  of  A), the  extreae  points  aay  be  coaputed  by  perforalng  a  succession  of 
pivots.  First  append  the  constraint  c'x'  >  x^*^  to  (PR')  (induced  by  (PR) 
via  the  change  of  variables),  introducing  its  slack  variable  as  the  additional 
basic  variable  In  the  optlaal  solution.  Now  successively  introduce  each  nonbaslc 
variable  (x^  :  J  €  JR)  into  the  basis  while  reaovlng  the  variable  that  was 
Introduced  Into  the  preceding  basis.  The  first  n  components  of  the  resulting 
n  basic  solutions  are  the  desired  extreme  points. 

An  explicit  representat ion  for  the  p  has  already  been  given,  obviating 
the  need  for  finding  M  1  or  even  constructing  H. 

Hence,  thought  the  theory  Involved  in  arriving  at  this  approach  is  rather 
involved,  the  only  additional  storage  (beyond  that  of  the  underlying  algorithm) 
is  •  0,...,n),  Pq®,  l/»^^(J«OQ+l,...,n),  nR,  and  a  vector  indicating 

which  j  are  In  J^.  The  latter  is  needed  to  deal  with  the  required  change  of 
variables.  The  added  computation  involves  the  change  of  variables,  the  addition 

of  the  constraint  c’x'  _>  to  (PR').  n  pivots  to  find  x(l* . x<n), 

the  computation  of  1/x^ ( ^ (J-nQel , . . . ,n)  and  then  one  addition  and  comparison 
for  each  partial  solution  in  the  enumeration  scheme  delineated  in  the  previous 
section. 

These  modest  computational  and  storage  requirements  suggest  that  we  should 
usually  be  able  to  efficiently  investigate  a  relatively  large  number  of  variables 
with  this  bounding  technique.  In  fact,  a  similar  technique  embedded  in  Htlller'a 
Bound -and -Scan  algorithm  for  the  general  Integer  linear  programming  problem  has 
proven  to  be  quite  efficient  under  computational  testing  |3]. 


We  know  that  n  .  the  number  of  varlablea  that  are  not  handled  by  thla 
0 

technique,  la  bounded  above  by  a,  the  number  of  functional  conatralnta.  Thla 
reault  followa  from  Welngartner* a  proof  that  at  moat  m  of  the  original  varlablea 
can  be  baalc  In  a  aolutlon  to  (P)  (8,  pp.  35-37J.  Therefore,  the  bounding  technique 
aeeaa  particularly  promlalng  for  problema  where  m  la  amall,  alnce  relatively 
tew  varlablea  would  then  need  to  be  handled  by  the  underlying  algorithm. 

In  auamtary,  In  a  a  imp  lex-baaed  Implicit  enuawratlon  procedure  to  aolve  (P), 
the  uae  of  thla  bounding  technique  for  problema  where  the  number  of  conatralnta 
la  amall  In  romparlaon  to  the  number  of  varlablea  aeema  very  promlalng  computa¬ 
tionally.  It  will  be  Implemented  and  teated  In  the  near  future  and  the  reaulta 
repotted. 
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